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Problem: 


It is axiomatic that equipment selection is one of the most critical functions of data 
processing management. Moreover, there are many facets to the problem, such as vendor 
support after the sale, that deserve as much consideration as the quality of the hardware. 


This report conveys the results of Datapro’s 1986 survey of User Ratings of Mainframe 
Systems. This year’s survey summarizes the users’ experience with more than 1,300 
installed mainframe systems. The users’ ratings pinpoint strengths and weaknesses of 
each manufacturer’s equipment, software, and support, and provide information that 


should be of great value in computer acquisition. 


Solution: 


Datapro is pleased to present, in conjunction with 
Computerworld, the 1986 edition of the annual Com- 
puter Users Survey. This year’s survey is based on 
responses to questionnaires mailed to a cross-section 
of computer sites listed with International Data Cor- 
poration (IDC). This report summarizes the results 
received from mainframe users. For the results of the 
minicomputer users polled, please refer to Report 
E90-100-201, which follows. 


The users were asked to rate their systems in 23 
subjective categories and respond to a variety of ques- 
tions covering such areas as system configuration, 
programming languages, and planned acquisitions. 
They were also asked if they would recommend the 
system to other users. 


This report includes a number of charts and tables for 
easy comparison of the various systems. In many 
cases, we have also compared the 1986 survey results 
with the 1985 results to help you spot trends and 
changes. 
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We would like to stress that individual profiles or 
ratings should never be the major consideration in 
making an acquisition decision. The reader can use the 
material in this report to help formulate questions 
about a computer system as the evaluation process 
proceeds. The information within this report is very 
informative if used with discretion and with the under- 
standing that there are many factors involved in select- 
ing the right computer system to meet your particular 
needs. 


SURVEY METHODOLOGY 


The 1986 survey has been based on results received 
from 14,344 questionnaires mailed to known com- 
puter users listed with IDC. The total number of 
questionnaires was divided into two groups: 9,002 
surveys were mailed to minicomputer users and 5,342 
to mainframe users. In addition, the users were chosen 
based on the computer system they had installed. 
Datapro supplied IDC with a list of specific system 
models to be included, in the mailing, and the model 
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was listed directly on the mailing label. In an effort to 
improve the response rate and thereby increase the 
statistical validity, the users were contacted twice; a 
first request was followed two weeks later by a second 
request. 


Each questionnaire allowed the user to rate one com- 
puter system and specifically requested that the rating 
apply to the system listed on the label. The recipient 
was encouraged to reproduce the form if he/she wished 
to rate additional systems. The IDC labels were used as 
initial validation vehicles and for identification and 
elimination of invalid and duplicate returns. All re- 
turns were analyzed by senior Datapro analysts and 
some returns were judged invalid for one or more of 
the following reasons: more than one system model 
was rated on a single form; the response was a dupli- 
cate; the form was received after the deadline; the 
ratings section of the questionnaire was not completed; 
the systems rated were not mainframe or minicom- 
puter systems; or the response revealed a vested 
interest on the part of the respondent. In addition, 
system models receiving fewer than five valid re- 
sponses were grouped together under “Other Main- 
frames” or “Other Minicomputers.” 


Of the 14,344 questionnaires mailed, 3,701 responses 
were received from 3,509 respondents, a return of 26 
percent on the total mailing. Of the total responses, 61 
were judged invalid, giving us 3,640 valid responses 
from 3,448 users. Of these valid responses, 1,302 rated 
mainframe systems for a return of 24 percent, while 
2,338 rated minicomputers for a return of 25 percent. 


Datapro batched the valid returns by manufacturer 
and model and sent the returns to Mathematica Policy 
Research, Inc. for tabulation of the results. The sum- 
mary information was prepared in the form of either 
averages, percentages, or weighted averages. Weighted 
averages were computed in a manner similar to that 
used for most college grading systems: “‘Excellent” is 
weighted as 4, “Good” as 3, “‘Fair” as 2, and ““Poor”’ as 
1. The tallied numbers for each value are then multi- 
plied by the corresponding weight, and the average is 
taken by dividing the sum of the products by the total 
number of responses for that category. 


THE 1986 QUESTIONNAIRE 


Users were asked to answer 31 multiple-part ques- 
tions. Each user was asked to identify the manufac- 
turer and model of his/her system, as well as the month 
and year of installation and the method of acquisition. 
Users were requested to identify the type of industry 
their company was in, principal applications, and the 
sources of those applications programs. We also asked 
the users for information about their hardware and 
software configurations, and about acquisitions or 
implementations planned for 1986. 


© 1986 DATAPRO RESEARCH CORPORATION, DELRAN, NJ 08075 USA 


The remaining questions asked the users to rate 
various aspects of their computer systems. The cate- 
gories rated included ease of operation, reliability of 
system, reliability of peripherals, maintenance service 
(responsiveness and effectiveness), technical support 
(troubleshooting, education, and documentation), 
manufacturer’s software (operating system, compilers 
and assemblers, and applications programs), ease of 
programming, ease of conversion, and overall satis- 
faction. Additional ratings included timeliness of 
hardware installation; timeliness of software installa- 
tion; ease of expansion; compatibility of terminals, 
peripherals, and software carried over from other sys- 
tems; power/energy efficiency; productivity aids; soft- 
ware support delivered by the vendor; noise level of 
equipment; and ease of keeping up with and imple- 
menting vendor changes to hardware/software. 


This year we also asked users if they were using certain 
software packages in the following categories: data 
base management systems, data management systems, 
application development tools, utilities, communica- 
tions software, performance monitors or security sys- 
tems, and system enhancement packages. Users who 
checked off any of the listed packages were asked to 
rate those packages on a scale of 1 to 10, with 1 as the 
lowest rating and 10 as the highest. 


Finally, we asked if the computer system did what it 
was expected to do, and if the users would recommend 
their computer system to others. 


SURVEY RESULTS 


Table 1, “Mainframes by Vendor Summaries,” con- 
tains the results on 20 model groupings from 8 main- 
frame vendors, representing 1,302 user responses. 


Financial Alternatives 


Users have three options by which they can acquire 
their computer system: purchase, rent/lease from the 
manufacturer, or lease from a third party. Each 
method of acquisition offers its own benefits, and each 
method should be examined carefully to see which of 
these methods would be most beneficial to your com- 
pany. By using the purchase option, the user can enjoy 
benefits such as the investment tax credit and depre- 
ciation schedule allowances. With the rapid advances 
in technology, however, many users feel that rental/ 
lease from the manufacturer is the best option for 
them, because it allows them to upgrade faster to new 
systems. Also, many vendors include maintenance in 
the rent/lease price. The advantages a user can receive 
from third-party leasing are faster delivery and more 
attractive lease prices. 
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Method of 
Acquisition 1986 1984 


Purchase (%) 


Rent/Lease from 
Mfgr. (%) 


Lease from 3rd 
Party (%) 


Chart 1. Financial alternatives. 


One of the questions we asked, therefore, was how 
users acquired their systems: outright purchase, rental/ 
lease from the manufacturer, or third-party lease. 


Reference to Chart | shows that the percentage of 
purchased systems has decreased this year. For the 
past few years, the percentage of purchases has been 
going up, probably because many vendors, including 
IBM, were making outright purchase more attractive 
by lowering purchase prices and raising rental and 
lease prices. Perhaps in 1985 users found it more 
difficult to borrow the money needed to purchase a 
system outright, or they were less inclined to risk a 
large outlay of money until the economy improved. 


Industry and Applications 


One of the questions we asked the users was “What 
type of industry describes your company?” Chart 2 
shows the market penetration in each industry by 
manufacturer for each class of computer systems. 


We also asked the survey respondents to specify their 
principal applications. In 1986, as in 1985, the top 
three applications were accounting/billing, payroll/ 
personnel, and order processing/inventory control. 
(See Chart 3, “User Rankings of Principal Applica- 
tions.”’) Banking, in eighth place last year, moved up to 
seventh place, while Engineering/Scientific moved 
from seventh place to eighth place. Insurance, not even 
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Chemical/ 
Petroleum 


Manufacturer 


Government 
Medica! 


Amdahl (17) 
Burroughs (186) 
Control Data (9) 
Honeywell (64) 


Ooo | Health Care/ 


NCR (178) 
Sperry (88) 
Other (31) 


Chart 2. Computer usage by manufacturer and industry type. 
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Insurance 


Applications—1986 Applications—1985 


1. Accounting/Billing 1. Accounting/Billing 

2. Payroll/Personnel 2. Payroll/Personnel 

3. Order Processing/inv. Control 3. Order Processing/Inv. Control 
4. Purchasing 4. Purchasing 

5. Sales/Distribution 5. Sales/Distribution 

6. Manufacturing 6. Manufacturing 

7. Banking 7. Engineering/Scientific 

8. Engineering/Scientific 8. Banking 

9. Education 9. Education 

0 0 
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. Insurance . Mathematics/Statistics 


Chart 3. User rankings of principal applications. 


in the top 10 last year, replaced Mathematics/Statistics 
in tenth place. 


Hardware Configurations 


Several of the survey questions asked users to describe 
their hardware configurations. Main memory capaci- 
ties continue to increase. About 40 percent of the 
mainframe users had at least 16 megabytes of main 
Memory on their systems, with 26 percent using be- 
tween 16 and 32 megabytes. Five percent of the survey 
respondents had installed systems with more than 64 
megabytes of main memory. Just 2 years ago, the 
majority of the users had installed between 2 and 8 
megabytes of main memory, and only 2 percent of 
them were using more than 32 megabytes. 


Our survey also shows an increase in disk storage 
capacity. In 1985, 77 percent of the systems included at 
least 1.2 gigabytes of disk storage, up from 66 percent 
in 1984. In 1986, nearly 80 percent of the systems had 
at least 1.2 gigabytes of disk capacity, with 31 percent 
using more than 10 gigabytes. In 1985, only 20 percent 
used more than 10 gigabytes of disk storage. 


We also asked the users how many local workstations/ 
terminals and how many remote workstations/ter- 
minals they were using. Chart 4 shows the usage of 
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No. of Workstations/ 
Terminals 
per System 


Manufacturer 
& Model 


Amdahi 
580 Series (17) 


Burroughs 
A 3 (10) 
A 9 (14) 
V Series (7) 
B 2900/B 3900 (82) 
B 4900/B 5900 (45) 
B 6900/B 7900 (28) 


Control Data 
All Models (9) 


Honeywell 
DPS 7 (30) 
DPS 8 (34) 


IBM 
4361 (120) 
4381 (219) 
4300, Other (55} 
308X Series (289) 
3090 Series (25) 


NAS 
All Models (21) 


NCR 
8500/8600 (178) 


Sperry 
1100/60 (26) 
1100/70 (57) 
1100/90 (5) 


Other (31) 


All Mainframes (1,302) 


Chart 4. Usage of local and remote workstations/terminals. 


local and remote terminals by manufacturer and 
model. About 50 percent of the mainframe users had 
more than 60 local terminals in operation, while 45 
percent were using more than 60 remote terminals. In 
1985, only 38 percent of the respondents had more 
than 60 local and 60 remote terminals. 


Software 


The computer application development life cycle is a 
highly labor-intensive cycle. As labor costs climb, so 
does the cost of software development. As computers 
increase in capability and speed, and as users become 
accustomed to results, the clamor for additional appli- 
cations increases. Because many systems already face a 
two-year backlog in bringing up desirable applications, 
it is quite common for users to seek multiple sources 
for applications programs. And as the proprietary soft- 
ware industry increases in maturity and sophistica- 
tion, “packaged” software becomes a desirable adjunct 
to in-house development. 
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We asked the users how they acquired their applica- 
tions software. First on their list was in-house person- 
nel. The preparation of software by in-house personnel 
is often a highly desirable route because of in-house 
management control plus, ideally, the total tailor- 
ability of the software to the user’s operational require- 
ments. Software from independent suppliers was 
ranked second by the users, followed by packaged 
programs from the manufacturer, contract program- 
ming, and programs prepared by the manufacturer’s 
personnel. The 1986 results on this question were 
identical to the 1985 and 1984 results. 


‘Which programming language should I use?” is a 
question that often results in a long debate among 
programmers and computer scientists. Because most 
studies show that it takes about the same amount of 
time to code an instruction, whatever the language, the 
answer would appear to be: ““Whichever language will 
result in the fastest possible documented implementa- 
tion of the application.” 
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Acquisition Plans—1986 


1. Expansion to Data Communi- 
cations Facilities (68%) 

2. Expansion to Present 
Hardware (65%) 

3. Additional Proprietary 


Acquisition Plans—1985 


1. Expansions to Present 
Hardware (67%) 

2. Expansions to Data Communi- 
cations Facilities (65%) 

3. Additional Proprietary 


Software (62%) Software (61%) 
4. Additional Software from 4. Additional Software from 
Mfgr. (53%) Mfgr. (52%) 


. Laser Printers (26%) 5. Business Graphics (14%) 


Chart 5. User rankings of planned acquisitions. 


For mainframe users, the most frequently used lan- 
guage was Cobol (77 percent), followed distantly by 
Assembler (8 percent), PL/1 (2 percent), and Fortran 
(1.6 percent). 


Acquisition Plans 


We asked how users were planning to spend their 
enhancement/acquisition dollars in 1986. Chart 5 
shows the user rankings of planned acquisitions. This 
year the top priority with users in the mainframe class 
is to expand their data communications facilities, 
closely followed by expansions to their present hard- 
ware and additions to their proprietary software. Ex- 
pansion to data communications facilities was in 
second place last year, but data communications and 
hardware seem to take turns in first place; the 1984 
results were identical to the 1986 results. 


On the 1986 questionnaire we added laser printers to 
our checklist, and found that 26 percent of the survey 
respondents planned to acquire laser printers this year. 


Disaster recovery is of critical importance to computer 
installations, so we asked the users if they had imple- 
mented a disaster recovery plan. More than 55 percent 
said they had done so, compared with 50 percent in the 
1985 survey. This year 18 percent reported that a 
disaster recovery plan was on their agenda, while 22 
percent reported such intentions last year. 


Information centers have been a hot topic in recent 
months, so we also asked the users if they had estab- 
lished an information center. Forty percent said that 
they had an information center, and 9 percent said 
they planned to add one this year. 


User Satisfaction Ratings 


Consistent with our belief that what users think is 
extremely important, we asked users to rate their 
computer systems and the associated software and 
vendor support by assigning a rating of Excellent, 
Good, Fair, or Poor to each of 14 factors: ease of 
operation, reliability of mainframe, reliability of 
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peripherals, maintenance service (responsiveness and 
effectiveness), technical support (troubleshooting, 
education, and documentation), manufacturer’s soft- 
ware (operating system, compilers and assemblers, and 
applications programs), ease of programming, ease of 
conversion, and overall satisfaction. All ratings are 
expressed in terms of Weighted Averages, which were 
calculated by assigning a weight of 4 to each user rating 
of Excellent, 3 to Good, 2 to Fair, and 1 to Poor, and 
then dividing the sum by the number of users who 
rated each factor. 


The individual responses by vendor appear in Table 1. 
In analyzing the ratings, we decided to see how many 
systems could meet the following criteria for special 
merit: a minimum of 20 user responses, an overall 
satisfaction rating of at least 3.20, and a rating of no 
less than 2.80 in all other system rating categories. Last 
year, two systems (the IBM 4381 and 3083) met these 
criteria. This year, not one of the systems met our 
criteria. 


For a number of other categories, we picked out those 
systems that received at least 20 responses and a rating 
of at least 3.50. Chart 6 shows the systems that met 
those criteria for ease of operation, reliability of main- 
frame, reliability of peripherals, and operating system. 
This year the number of systems meeting those criteria 
increased over the previous survey. In 1985, only one 


Weighted No. of 
Average Responses 


Ease of Operation 


Burroughs B 4900/B 5900 
Burroughs B 6900/B 73900 
NAS Advanced Systems 
Burroughs B 2900/B 3900 
Honeywell DPS 7 


Reliability of Mainframe 


NAS Advanced Systems 
IBM 3090 Series 

IBM 4381 

IBM 308X Series 

IBM 4361 

Honeywell DPS 7 
Burroughs B 4900/B 5900 
Sperry 1100/70 

Sperry 1100/60 


Reliability of Peripherals 


NAS Advanced Systems 
IBM 3090 Series 

IBM 308X Series 

IBM 4381 


Operating System 
Burroughs B 6900/B 7900 


Burroughs B 4900/B 5900 
Burroughs B 2900/B 3900 


Chart 6. Systems with the highest ratings in key categories. 
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system each made the grade in the ease of operation, 
reliability of peripherals, and operating system cate- 
gories, while five systems met our criteria in the reli- 
ability of mainframe category. 


Vendor service and support are key areas when con- 
sidering a computer system. Although users have no 
control over the effectiveness of maintenance service, 
they can influence promptness of maintenance service 
by spelling out their requirements in their contract 
with the vendor. 


We checked the survey results to see which vendors 
had received the highest overall ratings for mainte- 
nance service and technical support. To be listed in our 
chart, the vendor had to have a minimum of 20 user 
responses and a rating of at least 3.5 for maintenance 
service and 3.0 for technical support. Through the 
years that Datapro has been conducting this survey, we 
have found that the area of technical support usually 
receives the lowest ratings. We felt, therefore, that any 
vendor receiving a 3.0 rating in technical support was 
deserving of special mention. Chart 7 lists the vendors 
that met our criteria in these service categories. 


These results show a significant improvement in user 
satisfaction over the 1985 survey, in which none of the 
vendors met our requirements for maintenance, 
although IBM came close with a weighted average of 
3.47 for both maintenance responsiveness and mainte- 
nance effectiveness. IBM was also the only vendor last 
year to receive at least a 3.0 in any of the technical 
support categories. 


Expectations and Recommendations 


We asked the computer system users “Did the system 
do what you expected it to do?” This year, 95 percent 
answered “Yes,” 2 percent said “No,” and 3 percent 
said “Haven’t decided.” Last year, 96 percent an- 
swered “Yes.” 


The final question we asked users was whether they 
would recommend the computer system to another 
user in their situation. Ninety-two percent said “Yes,” 
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Weighted No. of 
Average Responses 


Maintenance Service: 
Responsiveness 


NAS 
Burroughs B 6900/B 7900 


Effectiveness 
NAS 
IBM 


Technical Support: 


Troubleshooting 


Burroughs B 4900/B 5900 


Education 
IBM 


Documentation 
NAS 


Chart 7. Systems with the highest ratings for service and support. 


3 percent answered “No,” and 5 percent said they 
“‘Haven’t decided.” In 1985, the numbers were 92 


percent, 4 percent, and 4 percent, respectively. 


The vendors that received the highest overall percent- 
ages of user recommendations were: 


NAS 100% 

IBM 95% 

Amdahl 94% 
THANK YOU 


Datapro extends a sincere thanks to all for responding 
to our 1986 survey of user experiences with computer 
systems. Without your participation it could not have 
been the success it is, and we hope that this compen- 
dium of the opinions of user colleagues will be of 
significant value to you. We look forward to hearing 
from you again next year. 
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Manufacturer and Model 


Survey item 


Burroughs 
Control Data 
Honeywell 


No. of User Responses 
Average Life of System (months) 
Acquisition Method (%) 
Purchase 
Rental or Lease from Manufacturer 
Lease from Third Party 


Principal Applications (%) 

Accounting /Billing 

Banking—Check Processing/Loans/Savings 
Construction/ Architecture 
Education—Scheduling/ Administration 
Engineering /Scientific 

Health Care/Medical 

Insurance 

Manufacturing 

Mathematics/Statistics 

Order Processing/Inventory Control 
Payroll/Personnel 

Petroleum/Fuel Analysis 

Process Control 

Purchasing 

Sales/Distribution 

Other 


Source of Applications Programs (%) 
In-house Personnel 
Contract Programming 
Manufacturer's Personnel 
“*Packaged’’ Programs from Manufacturer 
Independent Suppliers 


Location of Computer (%) 
Departmental System 
Organizational System 


Use Third-Party Maintenance (%) 
Yes 
No 


Have a Disaster Recovery Plan (%) 
Yes 
Plan to in 1986 


Have an Information Center (%) 
Yes 
Plan to in 1986 


Planned Acquisitions/Implementations for 1986 (%) 
Additional Software from the Manufacturer 
Proprietary Software from Other Suppliers 
Expansions to Present Hardware 
Expansions to Data Communications Facilities 
Unix-based Operating System 
Laser Printers 
Power Conditioning Systems 
Optical Disk Devices 


Table 1. Mainframe vendor summaries 
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Manufacturer and Modei 


Burroughs 
Control Data 
Honeywell 


System Ratings (4.0-1.0) 
Ease of Operation 
Reliability of Mainframe 
Reliability of Peripherals 
Manufacturer’s Maintenance Service: 
Responsiveness 
Effectiveness 


Manufacturer's Technical Support: 
Troubleshooting 
Education 
Documentation 


Manufacturer's Software: 
Operating System 
Compilers & Assemblers 
Applications Programs 

Ease of Programming 

Ease of Conversion 

Overail Satisfaction 

Additional Ratings (4.0-1.0) 
Timeliness of Hardware Installation 
Timeliness of Software installation 


Ease of Expansion 


Compatibility of Hardware Carried Over from Other 
Systems 


Compatibility of Programs/Data Carried Over from 
Other Systems 


Power/Energy Efficiency 

Productivity Aids Help Keep Programming Costs Low 
Software Support Delivered by Vendor 

Keeping Up with & Implementing Vendor Changes to 


Hardware/Software (Very Easy=4.0; Very 
Difficuit = 1.0) 


Did the system do what you expected it to do? (%) 
Yes 


No 
Undecided 


Would you recommend system to another user? (%) 
Yes 


No 
Undecided 


Table 1. Mainframe vendor summaries 
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Manufacturer and Model 


Other Mainframes 


No. of User Responses 
Average Life of System (months) 
Acquisition Method (%) 
Purchase 
Rental or Lease from Manufacturer 
Lease from Third Party 


Principal Applications (%) 
Accounting/Billing 
Banking—-Check Processing/Loans/Savings 
Construction/ Architecture 
Education——-Scheduling/ Administration 
Engineering/Scientific 
Heaith Care/Medical 
Insurance 
Manufacturing 
Mathematics/ Statistics 
Order Processing/Inventory Control 
Payroll/Personnel 
Petroleum/Fuel Analysis 
Process Control 
Purchasing 
Sales /Distribution 
Other 


Source of Applications Programs (%} 
In-house Personnel 
Contract Programming 
Manufacturer’s Personne! 
“Packaged’’ Programs from Manufacturer 
Independent Suppliers 


Location of Computer (%) 
Departmental System 
Organizational System 


Use Third-Party Maintenance (%) 
Yes 
No 


Have a Disaster Recovery Plan (%) 
Yes 
Plan to in 1986 


Have an Information Center (%) 
Yes 
Plan to in 1986 


Planned Acquisitions/implementations for 1986 (%) 
Additional Software from the Manufacturer 
Proprietary Software from Other Suppliers 
Expansions to Present Hardware 
Expansions to Data Communications Facilities 
Unix-based Operating System 
Laser Printers 
Power Conditioning Systems 
Optical Disk Devices 


Table 1. Mainframe vendor summaries 


JULY 1986 © 1986 DATAPRO RESEARCH CORPORATION, DELRAN, NJ 08075 USA 
REPRODUCTION PROHIBITED 


EYU-1U0U-11U0 
User Ratings 


User Ratings of Mainframe Systems 


Manufacturer and Mode! 


Other Mainframes 


System Ratings (4.0-1.0) 
Ease of Operation 
Reliability of Mainframe 
Reliability of Peripherals 
Manufacturer's Maintenance Service: 
Responsiveness 
Effectiveness 


Manufacturer's Technical Support: 
Troubleshooting 
Education 
Documentation 


Manufacturer's Software: 
Operating System 
Compilers & Assemblers 
Applications Programs 

Ease of Programming 

Ease of Conversion 

Overall Satisfaction 

Additional Ratings (4.0-1.0) 
Timeliness of Hardware Installation 
Timeliness of Software Installation 


Ease of Expansion 


Compatibility of Hardware Carried Over from Other 
Systems 


Compatibility of Programs/Data Carried Over from 
Other Systems 


Power/Energy Efficiency 

Productivity Aids Help Keep Programming Costs Low 

Software Support Delivered by Vendor 

Keeping Up with & Implementing Vendor Changes to 
Hardware/Software (Very Easy=4.0; Very 
Difficult = 1.0) 

Did the system do what you expected it to do? (%) 
Yes 


No 
Undecided 


Would you recommend system to another user? (%) 
Yes 
No 
Undecided 


Table 1. Mainframe vendor summaries 
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